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FAST HIGH PRECISION MATCHING METHOD 

Technical Field 

This invention relates to a method for fast high precision matching. 

Background of the Invention 

Pattern search is a simple yet powerful machine vision tool Given a template pattem and 
an image, its objective is to find all instances of the patterns in the image. It involves two 
steps, a search step and a matching step. The search step places the pattem at all valid 
poses (locations, rotation angles, sizes) of the image being searched. The matching step 
determines the goodness of the match between the pattem at a given pose and the subset 
of the image corresponding to the pose. For advanced applications, it is desirable that 
the matching step produces high precision (that is, subpixel position, subsampling scale 
and rotation) results. 

Normalized correlation method (Manickam, Swami, Roth, Scott D., Bushman, Thomas, 
15 "Intelligent and Optimal Normalized correlation for High-Speed Pattem Matching", 

NEPCON WEST 2000, February 2000) of fixed rotation and scale has been widely used 
as the matching method in many machine vision applications. The match score of 
normalized correlation is largely independent of linear variations in object shading 
caused by reflectivity or illumination variations. 

20 

A rotation and scale invariant pattem matching method was disclosed (Rotation and Scale 
Invariant Pattem Matching Method, US patent no. 6,640,008) that generates a polar 
coordinate representation of the pattem template image that allows for fast linear search 
of scale along the radius axis and rotation along the angular axis. A fast regular shaped 
25 pattem search method was disclosed (Fast Regular Shaped Pattem Searching, US patent 
application no. 10/255,016) that performs fast pattem matching with flexible projection 
kernels to construct regular-shaped pattems using an accumulation method. A fast 
invariant searching method was disclosed (Fast Invariant Pattem Search, US patent 
application no. 10/302,466). It generates rotation and scale invariant profiles for fast 
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30 invariant search using the fast regular shaped pattern construction method. In addition, a 
fast pattern searching method was disclosed (Fast Pattern Searching, US patent 
application no. 10/283,380) that performs fast scale and aspect ratio invariant search. 

The above prior art approaches are not designed for highly precise sub-pixel and sub- 
35 sampling matching. They return the discrete pixel position that yields the best match and 
the coarse rotation and scale estimate. A surface fitting approach (Gleason, S.S., M.A. 
Hunt, and W. B. Jatko, "Subpixel Measurement of Image Features Based on Paraboloid 
Surface fit", SPEE Vol. 1386. Machine Vision Systems Integration in Industry, 1990) is 
attempted for subpixel matching. This approach fits the surface of the template matching 
40 scores (such as normalized correlation values) and estimates the maximum position from 
the surface for subpixel matching results. The fitting method suffers from the underlying 
nonlinear matching functions whose scores cannot be well characterized by the fitting 
surfaces. This, therefore, could yield misleading subpixel (for shift) or subsampling (for 
rotation and/or scale) matching results. It is reported that the error of the template 
45 matching score fitting based method is about 13% (Frischchlz Robert W. and Spinnler, 
Klaus P. "Class of algorithms for real-time subpixel registration" Proc. SPIE Vol. 1989, 
p. 50-59, Computer Vision for Industry, Donald W. Braggins; Ed). 

A more accurate approach is to perform subpixel and subsampling interpolation in the 
50 image domain. Then, template matching is performed on the interpolated higher 

resolution image. This could yield more accurate results than performing interpolation on 
the matching score surface. Depending on the interpolation method, system noise and 
the number of bits per pixel used to quantized the data, it is expected that a midrange 
error of 0.01 to 0.05 pixel could be achieved using this method (Frischchlz Robert W. and 
55 Spinnler, Klaus P. "Class of algorithms for real-time subpixel registration" Proc. SPIE 
Vol. 1989, p. 50-59, Computer Vision for Industry, Donald W. Braggins; Ed). However, 
interpolation on the image domain for high precision matching requires large data volume 
and matching computation, which is too expensive for deployment in practical 
applications. 
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A prior art approach ("Golden template comparison for rotated and/or scaled images" US 
patent no. 5,850,466) stores, in an array, a varied plurality of golden template images, 
each golden template image being characterized by a different combination of rotation 
and/or scale and/or sub-pixel translation. The array is indexed by the respective quantized 
65 rotation and/or quantized scale and/or sub-pixel translation of each version of the golden 
template image. This approach still requires a large number of template storage and 
computational cost for matching at high precision. So it is still impractical. 

Objects and Advantages 

This invention provides a fast method for high precision matching with the equivalent 
70 subpixel and subsampling interpolation in the image or template domain without actual 
performing the subpixel interpolation and/or subsampling. It achieves the high precision 
through sampling parameter optimization. Therefore, very fine sampling precision can 
be accomplished without the difficulty of high resolution image/template storage and 
expensive computation for actual matching at high resolution. 

75 

This invention includes a robust high precision matching method that allows the 
matching of noisy or imperfect data by limiting the contribution from each pixel and/or 
weighting the pixels by their significance/reliability, etc. The speed advantage is 
applicable to the robust matching methods of this invention. 

80 

This invention is generalized to include the high precision scale and rotation invariant 
matching through parameter optimization on log-converted radial-angular coordinate. 
This invention can be easily generalized to three-dimensional or higher dimensional 
invariant high precision pattern search and can achieve even greater speed advantage 
85 comparing to the prior art methods. Therefore, it can be used in applications such as 3D 
medical imaging, dynamic medical imaging, confocal microscopy, live cell assays in 
drug discovery, or ultrasound imaging. 
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A further objective of this invention is to allow the software implementation of the fast 
90 high precision matching method in a general computer platform without any special 
hardware to reduce cost and system complexity. 

Summary of the Invention 

A fast high precision matching method receives an input image and a template. An initial 
search method uses the input image and the template to create an initial search result 
95 output. A high precision match uses the initial search result, the input image, and the 

template to create a high precision match result output. The high precision match method 
estimates high precision parameters by image interpolation and interpolation parameter 
optimization. The high precision match method also performs robust matching by 
limiting pixel contribution or pixel weighting. An invariant high precision match method 
100 estimates subpixel position and subsampling scale and rotation parameters by image 
interpolation and interpolation parameter optimization on the log-converted radial- 
angular transformation domain. 

Brief Description of the Drawings 

The preferred embodiment and other aspects of the invention will become apparent from 
105 the following detailed description of the invention when read in conjunction with the 

accompanying drawings, which are provided for the purpose of describing embodiments 
of the invention and not for limiting same, in which: 

Figure 1 shows the processing flow for the fast high precision matching method; 
Figure 2 shows the processing flow for the high precision match within one pixel range; 
1 10 Figure 3 shows the processing flow for the high precision match beyond one pixel range; 
Figure 4 shows a matching function maximization method that finds the best a and 
/? values; 

Figure 5 shows the processing flow of the fast high precision projection match; 
Figure 6 shows A matching function maximization method that finds the best a,p , y , 
115 and S values. 
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Detailed Description of ttie Invention 

I. Application Scenarios 

120 A high precision matching produces highly precise results such as subpixel matching 

positions, high precision angles, scales, and/or focus positions. The processing flow of a 
fast high precision matching application scenario of this invention is shown in Figure 1. 

As shown in Figure 1, the input image 100 and the template 102 are processed by an 
125 initial search 104 step. This results in an initial search result 108 output. The initial 
search 104 method searches through a large volume of data to identify the initial 
locations, scale, and angles that correspond to the match candidates. The initial match is 
fast but results are often not precise. In one embodiment of the invention, a "Fast Pattern 
Searching", US patent application no. 10/283,380 and a "Fast Invariant Pattern Search", 
130 US patent application no. 10/302,466 is used for initial search. Those skilled in the art 
should recognize that other methods such as standard normalized correlation method or 
geometric pattern matching method could be used for initial search. The initial search 
results are refined by the high precision match 106 step to create a high precision match 
result 110 output having subpixel matching positions, high precision angles, scales, 
135 and/or focus positions. 

The initial search includes non-invariant and invariant searches. Similarly, the high 
precision match includes non-invariant and invariant high precision matches. Non- 
invariant search and match methods search and match template position(s) from an input 
140 image 100. The invariant search and match methods search and match template 102 and 
input image position subject to rotation, scale, and other variations such as focus changes, 
etc. 

n. Non-invariant High Precision Match 
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The non-invariant high precision match method produces sub-pixel matching results. In 
one embodiment of the invention, the basic formula of the non-invariant high precision 
match is described in the following section. 



150 n.l. Matching Function 



The typical matching operation is based on the normalized correlation method. The 
normalized correlation based matching function between two images / and /, Mat(IJ), 
can be described by the following formula: 



155 



Mat(IJ) = 



COVjlJ) 
ylVAR(I)VARiJ) 



160 



Where COV(I,J) is the covariance between images / and J and is described by the 
following formula 



1 Yi 

COV(IJ) = -'^I[x][y]J[x][y]- -Y.I[x][y] -^J^ly] 



. N N 



and the variance of image /, VAR(I) is described as 



165 Vmi) = j^Y.^[x][y]I[x][y]-^^ 



The image region area N is described as N = "^1. 



x.y 



The variance of image 7, VAR(J) can be similarly defined. 



170 n.2. High Precision by Image Interpolation 



175 
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The high precision is achieved by image interpolation. In one embodiment of the 
invention, the image interpolation is performed by linear interpolation. As an example, 
we describe bilinear interpolation between four pixels in this section. 

Let the interpolated image of input image / be Kap • Where a and /?(0<a,/?<l)are 

subpixel values in x and y dimensions. In the bilinear interpolation method, the pixel 
value of the interpolated image is described by the following formula: 



Those skilled of art should recognize that any linear interpolation method such as 
weighted linear interpolation could be used in the invention for high precision matching. 
Furthermore, the interpolation could include more than 4 pixels. 



185 



The covariance of the Kap J can be written as 

( Y ^ 

= (l-a){l-P)COV{looJ)+aa-P)COVUioJ)+fia-(x)COViio,JH^ 



190 Where 



1 r 1 Y 1 ^ 

COVa,„,J) = -'^I[x+l][y + m]J[x][y]- -Y,nx+l][y + m] ^ZJ^x][y] 

Xyy 



x,y 



x,y 



for /,m = 0,l. 



195 



The variance of the Kap and J can be written as 



f Y ^ 

VAR(Kap) = ^Kap[x][y]Kap[x][y]- Y.Kap[x][y] Y.Kap[x][y] 

x,y \x,y J\x,y 



= (1 - ory (1 - VA/?(/oo) + a' (1 - /?r VAi?(/io) + /^^ 
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+ 2a{l-a)il-fifCOVU^,Iw) + 2J3a-/J)il-afCOVU^,Iod 
+ lafiil - ar)(l - /3)[C0Vii^ , /„) + CO V(/,o , /o,)] 

200 + 2 a' PiX - P)COVUx, ,Iu) + 2a/3\l- a)CO V(/o, , /, ,) 



Where 



1 (] Yi 

COVU,.,I,,) = -'^I[x + l][y + m]I[x + q][y + r]- -"^Hx + my + m] --'^I[x + q][y + r] 

x,y V^" x,y )\ x,y 



205 for q,r = OandL And 



1 f 1 Y 1 

VmiJ = -'Zl[x+l][y + m]I[x + l][y + m]- -J^/U + ZJEy +m] -^I[x+l][y + m] 

^ x,y I ^ jc,y A 



From the above formula, the matching function Mat(I,J), can be described as a function 
210 of the subpixel values a and /? . 



The high precision match result around a pixel position (x,y) is the subpixel values a 
and J3 correspond to the maximum value of the above matching function. When the 
initial search accuracy is within one pixel precision, the high precision match can be 
215 performed for the optimal subpixel values within each of the initial search result position 
(x,y). The processing flow of the high precision match within one pixel range is shown 
in Figure 2. The input image 100 and the initial search result position (x,y) 200 are used 
along with the template 102 for matching function maximization 202. This results in the 
optimal subpixel values 204. 

220 

Those skilled in the art should recognize that multiple within one pixel range high 
precision matches can be used if the initial search result includes multiple candidate 
positions. 



225 



When the initial search result is not within one pixel precision, the high precision match 
can be performed for the optimal subpixel values within the pixel or the neighboring 
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pixel of each of the initial search result position (x,y). The subpixel position whose 
maximum matching function is the highest among those of the pixel or the neighboring 
pixel is the optimal subpixel position of the high precision matching. The processing flow 
230 of the high precision match beyond one pixel range is shown in Figure 3. 

As shown in Figure 3, a neighboring position creation module 300 takes the initial search 
result position (x,y) 200 and creates s number of neighboring positions, 302,. . 304. In 
one embodiment of the invention, the 3 by 3 adjacent neighbors of (x,y) are selected. 
235 That is, s = 8. In another embodiment of the invention, the pixels inmiediate above, 

inmiediate below, immediate to the left, and immediate to the right of (x,y) are selected. 
Therefore, s = 4. Those skilled in the art should recognize that other methods of 
neighboring position generation could be used and they are all within the scope of the 
current invention. 

240 

The initial search result position (x,y) 200 and its neighboring positions, 302, 304, 
are used to perform matching function maximization 202 for their respective within one 
pixel position. The maximum values for each position 306, 308, . . ., 310, are compared 
and the global maximum is selected by the maximum and position determination module 
245 312. The optimal subpixel values 204 are the values correspond to the position having 
the highest matching function value among the initial search result position (x,y) 200 and 
its neighboring positions, 302, 304. 

In another embodiment of the invention, the beyond one pixel range high precision 
250 matches is performed by using more than four pixels for bi-linear interpolation. For 
example 16 pixels could be used for interpolation. 

Those skilled in the art should recognize that multiple beyond one pixel range high 
precision matches can be applied if the initial search result includes multiple candidate 
255 positions. 



n.3. Matching Function Maximization 
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The matching function maximization method finds the maximum parameters that yield 
260 the maximum matching function. The matching function maximization can be performed 
using optimization methods such as the random optimization method, first order, second 
order, or quadratic fitting, etc. 

To determine Mat(l,J) as a function of a and fi, Mat{a,p ), we rewrite COViKo^J) and 
265 VAR(Xafi) as: 

COViKap ,J) = Axap + A2a + A3P Aa 
Where 

270 A, = CO V(/oo , 7) + COK(/„ , 7) - CO V(/,o , 7) - COV{u, ,J), 

A2 = COV(lio,J)-COVUoo,J), A3 = COVUoi,J)-COViloo,J), A, = COVU^,J), 

and 

275 VAR^Kap) = Bxap" + B^a P + B^a + B^ap + B^a ^B^P^^ Bia + BsP + B9 
Where 

B, = VARil^) + VARil,o) + VARil,d + VAROn) + 2COV(/oo, /„) + 2COV(/,o, /oi) 

280 - 2COV(/oo , /,o) - 2COV(/oo , hi) - 2COVil,o , /„) - 2C0 V(/o, , /„) , 

B2 = -2VARii^) - IVARQ^o) + 4COVUoo , ho) + 2C0V{l^ , hi) 

- ICOVOoo , /n) - 2COV(/,o , /o,)(/,o , hi) + 2C0y (7,0, /„) , 

53 = -2VARiioo) - 2VAR{hd + 2C0V{l^ , 7,0) + 4COV(7oo, 7oi) 

-2COV(7oo.7„)-2COy(7,o,7oi)(7io,/oi) + 2COy(7o„7u), 
285 54 = 4VA/?(7oo)-4COV(7oo.7,o)-4COy(7oo,7oi) + 2COy(7oo,7n) + 2COV(7,o,7oi), 

fis = VA/?(7oo) + VARQio) - 2C0y (7oo , 7,o) , Be = VARQoo) + VAR(hi) - 2COV(7oo , 7oi) , 
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Bi = -2VAR(loo) + 2C0y (/oo , /,o) , flg = -2VAR(loa) + 2COV{i^ , /o,) , and 
B9 = VAR(i^). 



290 The necessary condition for maximizing the matching function is 



dMATja,/}) ^ dMAT{a,p) ^ 
da dp 

Equivalently, 

da dp 

295 

Where M(a, P) = [MAT{a, P)f ■ This results in 



da da 

and 

dp dp 



From the above formula, for a given ;5 (0 < < 1 ), the best a can be determined by the 
following formula: 



P^P'+PiP'+PiP + Pi 
Where 



Px = AiBi-2AiBi, P2 = A^B^ + A2Bi-2A3B2-2AABi, 

P3 = 2AlB6-A3B3, P4 = AB7 + A2B4-2A3B5-2AaB2, 

310 P5 = 2AiB» + 2A2B6- A3B4- A4B3, P6 = 2AiB9 + 2A2B9- AsBi- A4B4, 
Pt = AzBi-2AABi, Pi = 2A2B9- AaBi 
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Since a is between 0 and 1. So we set a = 0 if the above a calculation results ina<0. 
Similarly, we set or = 1 if the above a calculation results in a>l. The formula for 
315 determining the best /? value when an a is given, can be calculated using a similar 
method. 

In one embodiment of the invention, the matching function maximization method that 
finds the a and y5 is performed by an iterative procedure as shown in Figure 4. 

320 

As shown in Figure 4, an initial p value 400 is selected. The value could be randomly 
selected between 0 and 1 or could be a pre-determined value such as 0.5, etc. Using the 
initial p value, the best a value can be found 402 by the above close form solution. The 
best a value is in term used to find the best p value 404. The best P value can then be 
325 apphed back to the best a finding 402 and then best p finding 404 processes. This 

process is iterated until the a and p values are stable (having little change per iteration) or 
an exit condition such as the maximum number of iterations is reached. The resulting a 
and p values are the best a and p values 406. 

330 Those skilled in the art should recognize that other methods of optimization could be 
applied to determine the optimal subpixel values. 

n.4. Fast High Precision Match 

335 The matching function, Mat(IJ), described in section n.l matches two images / and J. If 
we assume that / is the input image and J is the template, then we need to calculate the 
variance parameters Bi, B2, B3, B4, B5, Be, B7, Bg, and B9 for each candidate regions of 
the input image since the interpolation is performed on the input image. This could be 
time consuming if there are many candidate regions for matching. A fast high precision 

340 matching can be achieved by interpolating on the template. In this case, the matching 
function can be described as: 
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Mat{Ultmp) = ■ — 



^VAR(IWARiLmp) 

345 Wherein the variance parameters Bi, B2, B3, B4, B5, Be, B7, Bg, and B9 of the variance 
VAR[if„p (or, /])] can be pre-calculated for the fixed template. Therefore, only the 

covariance parameters Ai, A2, A3, and A4 of the covariance term COV[Ijitmp((x,fi)] has 

to be calculated during the high precision matching process for each input region. 

350 n.5. Fast High Precision Projection Match 

Image projection is often performed in fast template search to reduce the search 
dimensions. A fast regular shaped pattern search method was disclosed (Fast Regular 
Shaped Pattern Searching, US patent application no. 10/255,016) that performs fast 
355 pattern matching with flexible projection kernels to construct regular-shaped patterns 

using an accumulation method. The high precision match method of this invention could 
be applied to projected images. 

The image projection profile P of an image / can be described as the summation over a 
360 given geometric region R. 



P[x][y]= Z^[x + u][y + v] 

(M,v)€/f 



We interpolate image pixel values by bilinear combination as follows: 

365 

IaAx][y] = (l-a)(l-j3)I[x][y] + a(l-mx^l][y]^ 



370 



Then the projection profile values of the interpolate image pixel values are the bilinear 
combination of the non-interpolated projection values. That is, image interpolation first 
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and then projection is equal to image projection first and then interpolate on the 
projection profiles. 



(u,v)€/? 

375 = (1 " - fi)P[x][y] + a(l - fi)P[x + l][y] + J3(l - a)P[x][y + 1] + aj3P[x + + 1] 

Based on this property, the above disclosed matching function optimization method could 
be similarly applied to achieve fast high precision match on projected image. The 
processing flow of the fast high precision projection match is shown in Figure 5. 

380 

As shown in Figure 5, the input projection profile 500 and the template profile 502 are 
subject to high precision projection match 504. The high precision projection match 504 
can be performed by either interpolating the input project profile 500 or interpolating the 
template profile 502. The high precision match 504 process optimizes the interpolation 
385 parameters by maximizing the projection domain matching function using the same or 
similar methods as described above. The resulting optimal interpolation parameters are 
the high precision projection match result 506. 

n.6. Robust Matching 

390 

In many practical applications the input image could be degraded due to noise, artifact, 
distortion, missing features, etc. To achieve high precision matching results, robust 
matching scheme may be required. Two high precision robust matching methods are 
provided in this invention: limiting pixel contribution and pixel weighting. The speed 
395 advantage is applicable to the high precision robust matching methods of this invention. 

In one embodiment of the invention, the limiting pixel contribution method limits the 
contribution of each pixel to the covariance value calculation by the following rule: 
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1 r 1 Y 1 

400 COV(I,J) = -j;^Min(I[x][y]J[x][y],Cro^)- -^I[x][y] -^ZJ^x^y] 



N 



» N 



] 

J 



Where Cmax is the maximum allowable cross product value for a pixel. 

Based on the new covariance calculation formula, the matching function, Mat(I,J), is 
405 updated and the same procedure for high precision parameter estimation applies. 
Therefore, the speed advantage is preserved. 

In another embodiment of the invention, the robust matching is accomplished by 
weighing pixels with their significance/reliability. Pixels with noise, distortion, etc. are 
410 given lower weights for matching. 



In this case, the variance and covariance can be calculated by the following rule: 



COV(IJ) = :^Y.^[x][y]I[x][y]J[x][y^ 



. W 



415 



1 f \ Y 1 

VAR{I) = --ZW[x][y]I[x][y]I[x][y] - -—Y,mx]{y]I[x][y] —-Y:^[x\[y]m[y] 

" T X^y V " T if.v /V T r V 



w 

T x,y 



] 



Where the total weight Wf= ^W[x\[y] 

x,y 

420 Based on the new variance and covariance calculation formula, the matching function, 
Mat(I,J), is updated and the same procedure for high precision parameter estimation 
applies. Therefore, the speed advantage is maintained. 



425 



In yet another embodiment of the invention, the limiting pixel contribution and the pixel 
weighting methods can be combined. The combined covariance calculation formula is as 
follows: 
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COViIJ) = :^Y^Minmx][y]I[x][y]J[x][ylC^)-(-^ 

^ T x,y V " r x,y J\ T x,y 



430 



The combined covariance can be used for fast high precision match. 



LI. Invariant High Precision Match 



435 The invariant high precision match method handles scale and rotation invariant matching 
and produces sub-pixel position and high precision rotation angle and scale values as 
matching results. In one embodiment of the invention, the basic formula for the high 
precision scale and rotation invariant match is described in the following section. 



440 in.l. Matching Function with Scale and Rotation In variance 



In addition to the sub-pixel matching, the scale and rotation invariant matching requires 
sub-sampling on scale and rotation adjustment. The scale and rotation sampling is 
nonlinear in regular pixel coordinate. The prior art approach performs nonlinear re- 
445 sampling to achieve scale and rotation invariance, which is time consuming and error 
prone. 



Therefore, we perform radial-angular coordinate transformation first. The rotation angle 
is linear in the radial-angular coordinate. However, the scale factor is still nonlinear in 
450 the radial-angular coordinate. This invention performs log-converted radial-angular 
transformation that is linear in both scale and rotation sampling. 



in.2. Log-converted Radial-Angular Transformation 



455 



The log-converted radial-angular coordinate transformation takes advantage of the 
relationship log(^) = log^ + log r to the radial-angular coordinate transformed domain. 
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Therefore, the effect of the scale factor is an offset in the log-converted radial-angular 
coordinate system. 



460 Considering the radial-angular fr, 6) coordinate system, where r denotes radial distance 
from the center {xc, yc) and ^denotes angle. Any point can be represented in radial- 
angular coordinates ("r, 9}\ 

465 ^ = tan-'(^^^) 

Let p = log r , the coordinate transformation between the Cartesian coordinate system 

and the log-converted radial-angular coordinate system is described by the following 
formula: 
470 x = exp(y9)cos^ 
3; = exp(p)sin^ 
The area element is 
dxdy = txp(2p)dpd0 = r^dpdO . 

475 Let the image ^ be the weighted transform image of the log-converted radial-angular 
coordinate as follows: 

W][p] = exp(/7)/[^][y9]. 
480 In the transformed domain, the matching function for images can be defined as 



,VT. coy (4^, CD) 

ylVARQ¥)VARi 

Where 



- 18/30 - 




and 




490 



495 



500 



505 



Where = 2^1 . This matching function bears the same form as the shift invariant 

matching function. Therefore, the bilinear interpolation or other linear interpolation 
methods can be used for invariant high precision match. 

ni.3. Sub-pixel and Sub-sampling Shift, Rotation and Scale Invariant Matching 

In this invention, sub-pixel and sub-sampling image interpolation are used for high 
precision shift, rotation and scale invariant matching. In the following we describe the 
method in two dimensional case. Those skilled in the art should recognize that this 
method is also applicable to higher dimensional case by adding more interpolation 
parameters for optimization. 

In the two dimensional case, the shift, rotation and scale invariant matching is 
accomplished by interpolation using four parameters. Two of the parameters, a and p , 
are interpolation parameters for position shift (translation). The other two parameters, 
y and 5 , are interpolation parameters for fine rotation and scale values. The quad-linear 
interpolated images in log-converted radial-angular coordinate system is represented as 



^[^][p] = (l-a)(l-Ml-/)(l-^)^oo[^][p] + Kl-^)4^oo^^ 
+ cr(l -/?){(!-- ;^)(1 - ^) ^,o[^][p] + ra - 4^io[^ + ^ 
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+ a/?{(l - /)(1 - ^ ) ^'n [^][p] + r (1 - ^) 4'n + l][p] + ^(1 - r) [^^ 

515 Where 4^00 is the weighted log-converted radial-angular coordinate transformed 
image of (jco.}^o)' ^io[^][p] is the weighted log-converted radial-angular coordinate 
transformed image of (xo + h ^q) • ^01 W][p] is the weighted log-converted radial-angular 
coordinate transformed image of (xo»yo "•"!)' ^uWMp] is the weighted log- 
converted radial-angular coordinate transformed image of (xo + 1, + 1) . Rewriting the 

520 above equation as 

Where 

f,ia,/3,r,S) = a-cc)il-m-m-S) , f,ia,j3,r,S) = (l-a)il-/3)ra-S), 

f,{a,/3,r,S) = a-a)il-m-r)S , f,ia,/3,r,S) = il-a)a-fi)rS, 
525 f,(a,/3,r,S) = aa-m-m-3) , fe(cc,/3,r,5) = ail-/3)ra-S), 

f,{a,p,y,S) = a{\-P){X-r)5 , f,{a,p,r,d)^ail-P)y5, 

f,ia,p,r,S) = a-a)P{l-r)il-S) , f,^((x,p,r,d) = (X-a)PY(X-6), 

f,,{a,p,r,S) = {l-a)Pa-r)S , f,,ia,p,r,S) = il-a)PrS, 

f,,{a,p,y,5) = aP{\-r){\-5) , f,,{a,p,y,d) = aPr{\-5), 
530 f^,(a,p,y,S) = aP(l-y)S , and f,,ia,p,y,S) = apyS. 

Also, 

A, m[p] = ^'oomip] , A2mp] = ^oo[^ + mp] , 
AdO][p] = wMip + 1] , AdOM =^oo[0+ mp + 1] , 
Asmip] = "Viomip] , Aemip] = ^'^o+im , 

535 Ai[0][p] = ^ioW][p + n, A8[^][/'] = Tio[^ + l][p + l], 
AMp] = To. mip] , Aio[^][p] = To. [0 + mp] , 
Anmip] = Toi[^][p + 1] , Ai2mp] = Toi[^ + l][p + l], 
Anmip] = Tu[^][p] . Aumip] = Tn + l][p] , 
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A.5[^][p] = 4>n[^][A> + l]. and Ai6[^][/c>] = ^ii[(9 + l][p + l]. 

540 

The covariance of 4^,0 is therefore 

C0VC¥,O) = f^f,{a,p,r,S)C0V{Ak,^) 
and the variance of ^ is 

k-l k>m 

545 

The matching score between ^,<D as a function of the high precision interpolation 
parameters is 

COy(^,<D) 



^VARQ¥)VAR(0) 



550 The best subpixel and subsampling matching can be determined by finding parameters 
cc , , / , and S that correspond to the maximum value of the MatQV,0\a,j3,y,S) . 
The parameters are the invariant high precision match result. This is an optimization 
problem similar to the above non-invariant high precision match. Many optimization 
methods can be used for determining the four parameters. Typical methods include 

555 random optimization (RO), bi-directional RO (BRO), improved BRO (IBRO), gradient 
method, alternative gradient method, and golden section method, etc. 

In one embodiment of the invention, the method to find a,j3,y , and S is described as 
follows. 

560 

Rewriting the COV^(^,<D) and VA/?(T)as 
and 

VARC¥) = fClf 



565 
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where 7 = [/„/2,...,/,6j > " = [coy(A„<I>).COV(Aa,0),...,C(9V(A,„0)f . and 



COy(A„A,) COV{K„K^) 
COV (A2,Ai) coy (A2.A2) 



C0V(A,.A,6) 
COy(A2,Ai6) 



C0ViAi6,Ad COV(A,6,A2) ••• COV(A,6,Ai6). 
570 Given fi,/ , and ^ , the value a for the optimum matching function is 



a = - 





1 

V5 a ^ Of/ 








1? '^^7 ) 




\Sa J a) 



575 /? = - 



Similarly, for given a,y , and 6 , the value yff for the optimum matching function is 



For given a, , and 5 , the value / for the optimum matching function is 



r = - 



580 



For given a,fi , and / , the value S for the optimum matching function is 



585 Where 



fa = 



590 
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'{\-p){\-Y\\-8) 


-{X-P)y(X-S) 




il-P)Yil-S) 






{\-P){\-y)S 


-(X-P)y5 




{\-P)y5 


(X-P){\-r){\-s) 




0 


{1-P)yO.-5) 




0 


i\-P)(\-Y)d 




0 


{\-P)Yd 




0 


-P(l-y)(l-S) 


8a = 


p{X-Y)0.-d) 


-Py(X-S) 




Py(i-S) 


-P(1-Y)S 




P{l-Y)S 


-PyS 




PyS 


P(l-Y)a-S) 




0 


Py(i-S) 




0 


P{\-Y)S 




0 


PyS 




0 


-{\-a){\-Y){l-S) 




'{].-a)(X-Y){X-S) 


-{X-a)Y{\-S) 




{X-a)Y{l-S) 


-{\-a)(X-Y)S 




{\-a)(X-Y)S 


-{X-cc)yS 




(X-a)YS 


-a(X-Y)(X-S) 




a{\-Y){l-S) 


-aY(X-5) 




ayil-S) 


- a(l - y)S 




a{l-Y)S 


-ayo 




ayS 


{\-a){\-Y)0.-S) 


Sb = 

H 


0 


{\-a)Y{\-5) 




0 


{\-a){\-Y)S 




0 


(l-a)YS 




0 


ail-Y)il-S) 




0 


aya-S) 




0 


a(l-Y)S 




0 


ayS 


5 


0 
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-il-a)(l-/i)S 
il-a)il-fi)S 
-ail-m-S) 

-a(l-fi)S 
a(X-P)d 
r~ -il-a)/3(l-S) 
(l-ami-S) 
-{\-a)pd 
{\-a)pS 
-aj3a-S) 

-aps 
apS 



-(X-a)(\-P){\-r) 
-{\-a){\-P)y 

{\-a){\-P)r 
-a{\-P)(X-Y) 

-ail-P)r 
a{l-p)il-r) 

a(l-P)r 
-il-a)Pil-r) 

-(l-a)Pr 
(L-a)Pil-r) 
(l-a)Pr 

-apa-r) 

-aPr 

apa-r) 

apy 



a-a)il-P)a-S) 
0 

(l-a)il-P)S 
0 

ail-P)il-S) 
0 

ail-P)S 
0 

il-a)p(l-S) 
0 

(l-a)pS 
0 

apa-S) 
0 
apS 
0 



(l-a)(l-yff)(l-r) 
a-a)(l-P)r 
0 
0 

a(l-P)il-r) 
a(X-P)y 
0 
0 

(1 -«)/?(! -r) 
{\-a)Py 
0 
0 

aPH-y) 
aPy 
0 
0 
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In one embodiment of the invention, the matching function maximization method that 
600 finds a,p , y, and S is performed by an iterative procedure as shown in Figure 6. 

As shown in Figure 6, thea,>3 , and S values are initialized 600 to initial values. The 
values could be randomly selected between the valid ranges or could be set to the middle 
of ranges or to expected values from initial search, etc. Using the initial parameters 
605 values, f and 5 are calculated 602. This allows the calculation of the best a value 

given ihQ p , y , and S values 604. The best a value is used along with the initial y and 

5 values to calculate the f ^ and f ^ values 606. This allows the calculation of the best p 

value given a , y , and S values 608. This process continues to calculate the best y and 
5 values, 616, 614, 612, 610. The calculated a,p , y, and S values 620 are used to 
610 repeat the estimation calculation. This process is iterated until the a,p , y , and S values 
are stable (having little change per iteration) or an exit condition such as the maximum 
number of iterations is reached. The resulting cr, /? , y, and S values are the optimal 
subpixel and subsampling values. 

615 Those skilled in the art should recognize that other methods of optimization could be 
applied to determine the optimal subpixel and subsampling values. 

When T is the template image and theO is the input image, the terms in VARQ¥) can be 
pre-calculated from the template. Only the terms of COVQ¥, O) have to be calculated 
620 for each input image regions of interest. This will speed up the invariant high precision 
match process. 



III.3. Robust Matching 
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625 The robust matching method described in section n.6 for non-invariant high precision 
match can be similarly applied for invariant high precision match. The robust matching 
methods include limiting pixel contribution and pixel weighting. 

The invention has been described herein in considerable detail in order to comply with 
630 the Patent Statutes and to provide those skilled in the art with the information needed to 
apply the novel principles and to construct and use such specialized components as are 
required. However, it is to be understood that the inventions can be carried out by 
specifically different equipment and devices, and that various modifications, both as to 
the equipment details and operating procedures, can be accomplished without departing 
635 from the scope of the invention itself. 



